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The  concept  of  * Uniting  conditional  age  dlstrl- 
butlon  of  a continuous  tine  Markov  process  whose  state 
space  Is  the  set  of  non-negative  Integers  and  for  which 
{0>  Is  absorbing  Is  defined  as  the  weak  Unit  as 
of  the  last  tine  before  t an  associated  "return"  Markov 
process  exited  fron  {0}  conditional  on  the  state,  j, 
of  this  process  at  t.  It  Is  shown  that  this  limit  exists 
and  Is  non-defective  If  the  return  process  Is  p-recurrent 
and  satisfies  the  strong  ratio  Unit  property.  As  a pre- 
liminary to  the  proof  of  the  main  results  some  general 
results  are  established  on  the  representation  of  the 
p-lnvarlant  measure  and  function  of  a Markov  process. 

The  conditions  of  the  main  results  are  shown  to  be  satis- 
fied by  the  return  process  constructed  fron  a Markov 
branching  process  and  by  birth  and  death  processes. 

Finally,  a number  of  Unit  theorems  for  the  limiting  age 
as  J-*-  are  given. 

Key  words:  Markov  process.  Uniting  age,  p-classlflcatlon, 
strong  ratio  limit  property,  Markov  branching 
process,  birth  and  death  process,  limit  theorems 
6reen  function. 
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1.  INTRODUCTION 

Levlkson  [19]  has  recently  Introduced  the  concept  of  the 
(limiting)  conditional  age  distribution  (CAD)  of  a Harkov  chain, 

{ Zn } with  state  space  $ ■ (0,1,...)  and  a single  absorbing  state 
{0}.  He  does  this  by  defining  T ’■  1 n -f { m | XR ■ 0}  where  the  Mar- 
kov chain  {X  >,  called  the  return  chain.  Is  obtained  by  concatenating 
n 

Independent  realizations  of  {Zn>,  that  Is,  transitions  of  the  return 
chain  within,  and  out  of,  T » S\{0)  are  governed  by  the  same  transi- 
tion probabilities  as  {ZnJ,  but  If  X„  ■ 0 then  Xn+1  ■ 1.  Levlk- 
son's  specification  differs  slightly  from  this,  but,  as  we  have 
argued  In  [22],  the  present  convention  seems  more  convenient.  The 

CAD  Is  the  distribution  {11m  P.  (T  » k|X„  ■ J))  (JeT)  if  this 

1 n n 

exists;  it  may  be  defective.  Levlkson  demonstrated  that  the  CAD  Is 
well  defined  and  non-defective  If  the  return  chain  Is  positive  re- 
current. The  present  author  [22]  has  shown  that  this  situation  ob- 
tains for  any  return  chain  which  Is  R-recurrent  and  enjoys  the  strong 
ratio  limit  property  (SRLP).  He  also  gave  an  example  showing  that 
the  CAD  can  exist  for  a R-translent  return  chain  but  (may)  be  de- 
fective. 

Levlkson  [19]  also  Introduces  certain  expressions  for  return- 
type  diffusions;  these  are  formal  analogues  of  those  derived  for 
{ Xfl } . He  derives  some  consequences  from  these  and  asserts,  again  by 
analogy,  that  they  are  also  valid  for  discrete  state  Harkov  processes. 

It  Is  our  purpose  In  this  paper  to  extend  the  basic  results  of 
[22]  to  Markov  processes.  As  In  this  reference,  we  shall  Initially 
broaden  our  scope  by  considering  an  appropriate  version  of  a regular 


i 


2. 

Markov  process  (Y(t);  t > 0}  for  which  S is  Irreducible  and  for  a 
fixes  aeS  define  Tft.u)  ■ sup  Sa(w)  n [0,t]  where  2Ta(w)  is  the 
closure  of  S#(w)  * (t|Y(t,w)  » a}  and  uctt,  the  domain  of  the  ran- 
dom variables  Y ( t ) (t  * 0);  see  Chung  [4].  We  shall  then  show  that 
provided  {Y(t)>  Is  p-recurrent  (Kingman  [16])  and  satisfies  the  SRLPf 
the  conditional  distribution  of  T(t)  given  (Y(t)  * j>  has  a non- 
defective limit.  While  the  proof  of  this  fact  Is  not  difficult.  It 
Is  not  the  triviality  that  Is  the  corresponding  discrete  time  proof. 

We  shall  then  specialize  to  return  processes.  This  program  requires 
some  results  on  the  representation  of  the  p-lnvariant  measure  and 
function  of  the  transition  matrix  (Pjj(t)],  Pjj(t)  * Pf(Y(t)  ■ J) * 
and  these  are  derived  In  S2.  In  S4  we  work  through  tit  case  where 
(Z(t)}  Is  a regular  Markov  branching  process.  In  this  case  the  re- 
turn process  corresponds  to  a special  case  of  state  dependent  Immi- 
gration. The  limit  theory  and  p-classlflcatlon  of  this  class  of 
processes  has  been  examined  by  Yamazato  [31]  and  Stewart  [27],  respec- 
tively. We  shall  look  at  regular  birth  and  death  processes  In  SS  and. 
In  particular,  show  that  the  CAD  always  exists  but  Is  non-defective 
Iff  the  return  process  Is  p-recurrent.  In  S4,  5 we  shall  obtain  some 
limit  theorems  for  the  CAD  as  j-»*.  Finally  we  make  the  obvious  point 
that  the  results  of  52,  3 can  easily  be  modified  If  the  minimal  state 
space  Is  a subset  of  (0,1,...)  and  In  particular  the  results  hold 
without  change  If  S - (0,1,. ...N). 

2.  REPRESENTATION  THEORY 

As  In  the  Introduction  we  let  (Y(t);  t > 0}  be  a Markov  process 
with  a countable  minimal  state  space  S and  stochastic  transition 

bli_ 
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matrices  (Pjj(t)]  for  which  p.jj(t)  > 0 whenever  t > 0 and  1,JeS. 
Then,  as  Is  shown  by  Kingman  [16]  the  limit 

p - 11m  (log  p^UJj/t 

exists.  Is  finite  and  Is  Independent  of  1 and  j.  We  call  p the 
decay  parameter  of  $ (and  of  the  process).  Furthermore,  there  exist 
sequences  (m^)  and  (x^>  satisfying  the  inequalities 

1 "lp1j^tJ  - e"Pt"j  1 PijU)xj  * e’Ptxl  (leS)*  (U 

1 cS  J cS 

We  say  that  {m^}  Is  a p-sublnvarlant  measure  and  {x^}  Is  a p-subln- 

varlant  function.  Furthermore,  we  call  S (and  the  process) 

p-recurrent  If  j eptp^(t)dt  » - for  some  leS  (whence  for  all 

1eS)and  p-translent  otherwise.  In  the  p-recurrent  case,  which  will 
be  our  primary  concern,  the  p-sublnvarlant  measure  (m^)  and  the  p- 
sublnvarlant  function  (Xj)  are  unique  up  to  constant  multiples  and 
are  p-lnvarlant,  that  Is  (1)  holds  with  strict  equality.  Finally, 
if  S Is  p-recurrent,  we  say  It  (and  the  process)  Is  p-posltlve  If 

11m  eptp^j(t)  > 0 for  some,  end  hence  for  all,  1,jeS.  When  the 
t 

limit  Is  zero  we  say  that  S Is  p-null.  If  3 Is  O-recurrent  we 
shall  call  It  recurrent  and  similarly  for  the  other  terms. 


In  the  p-posltlve  case  £ m.x.  < • and 

1e$  1 1 

eptp1J(t)  ♦ * "lxl 


(1,JcS). 


In  this  case 


11m  p1  j ( t ♦ t)/pkl(t)  - (1  ,J»k,lcS;  t>0) 


4. 

Whenever  this  property  holds  for  some  p 2 0 and  sequences  {m^}  and 
{x.},  we  say  that  the  process  has  the  SRLP.  If  S Is  p-recurrent 

J 

then  (2)  holds  Iff 

11w  SUP  P0o(t  + T,/poo(t)  * *”PT 

t P®* 

for  all  sufficiently  small  positive  t.  This  follows  because  { Y ( t ) } 
has  the  SRLP  If  every  skeleton  (Y(nh)},  h > 0 posessses  It  [18]  and 
(3)  Implies  that  Pruitt's  [24]  necessary  and  sufficient  condition  Is 
fulfilled.  Observing  that  the  skeleton  { Y ( nh ) > Is  R-recurrent,  where 
R ■ exp(ph),  and  that  the  R-Invarlant  measure  and  function  are  {m^} 
and  (Xj).  respectively,  (2)  now  follows  from  Pruitt's  results  via 
a Croftlan  theorem  [17]. 

All  the  results  above  are  analogues  of  corresponding  discrete 
time  results  [25].  In  this  case  there  are  also  representation  results 
for  the  R-Invarlant  measure  and  function  In  terms  of  a generating 
function  of  certain  taboo  probabilities.  We  shall  derive  an  analo- 
gous representation  for  the  present  case.  Our  proof  will  use  the 
SRLP,  which  Is  sufficient  for  our  purposes,  but  we  shall  also  show 
that  we  can  replace  the  SRLP  by  another  condition. 

We  now  assume  that  $ • (0,1,...)  and  Is  p-recurrent  and  also 
that  { Y ( t ) ) Is  wel 1 -separable  and  measurable;  see  [4].  It  Is  possible 
and  convenient  to  assume  that  (Y(t)>  satisfies  the  condition 

Y ( t ) - 11m  Inf  Y(s) . 
sft 

Let  acS.  We  can  always  define 

Ya(t,«)  - sup  5^Tw7n[0,t], 


(4) 


5. 


called  the  last  exit  tine  from  a before  time  t.  If  (4)  Is  satis- 
fied then  Y(y  (t.w))  » a.  Let  r (s,t)  ■ P (y.  S s)  and 
raj(s,t)  ■ P#(y4  < S.x(t)  ■ j)  (J+a).  Chung  [4,  511.12)  shows  that 
there  exist  functions  9aj(*)  which  are  measurable,  bounded 

everywhere  and  satisfy 

P,j(t)  " j0paa^t“s^9aj^s,ds  <5) 

and 

5Tr,j($>t)  ■ p„(»)9tj(t-$),  j|r,(s.t)  • p„(s)9,(t-«) 

where  g_(s)  » l ga<(s),  which  Is  continuous  and  non-increasing  In 
* aJ 

s. 

Assume  now  that  {Y(t)>  has  the  SRLP  (2).  Then  (5)  and  Fatou's 
Lemma  Implies  that 

• > »j/«a  > |o«pS9aj(s)ds  ( J+a) 

Let  " | epS9aj(s)<ls  ( J+* ) and  d#  * 1.  Now  Kingman  [161  has 
shown  that  p^(t)  * 0(e'pt)  and  hence  the  Laplace  transforms 
Paj(0)  * | e"0tPaj(t)dt  (jeS)  exist  for  0 > -p.  Moreover  from 
(5)  we  have 

paj(e)/paa*0)  " e"s09aj(s >ds  5 <* j ( 0) 
and  d.(e)*d.  (0*-p).  Using  Fublnl's  theorem  we  obtain 


j 


iEsd1(0,p1j(t)  * (I/Paa(0))  |^e"0S  Jpa1(s,p1j(t)ds 
- («et  fe-0(t+s)paj(t+s)ds)/paa(0) 


S eetdj(e). 


Monotone  convergence  now  yields  Zd^p^j(t)  <;  e”ptdj  » *s»  (dj) 

Is  p-sublnvarlant.  Thus  (dj>  Is  p-lnvarlant  and  fro*  our  normallza- 
tlon  we  have  »j  • *adj  (JeS). 

Now  let  A1  - (u  | Y(o»(d)  - 1)  and  If  P ( ) > 0 then  for 


ue&j  we  define 


Pj(<u)  ■ Inf  { 1 1 1 > 0,Y(t,w)  f 1). 

Finally,  for  wcA^  let 

aij(u)  ■ Inf  { t | t > p^ (w) ,Y( t,«)  ■ j). 


called 

the  first 

entrance  time 

from  1 to  J If  1 t J or 

the 

return 

time  to  1 

If 

i - j. 

Let  F^j(t)  * p^aij  - 

Then 

14,  p. 

205]  If  1 

* U 

V-> 

has  a continuous  derivative 

V 

anu 

PtJ(t)  • f (J+1 ) - (6) 

Let  j * a and  suppose  S Is  p>recurrent  and  that  (2)  Is  satisfied. 
Then  obvious  changes  In  the  preceding  argument  allow  us  to  conclude 
that  the  sequence 

f1  » | epSf1a(s)ds  (ifa),  f#  « 1 


Is  well  defined  and  that  ■ xafj. 


I 


] 


\ 

I 
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We  can  proceed  without  (2)  as  follows.  Let  Q * [q^l  be  the 
generator  of  {Y(t)},  that  Is,  ■ p'y(o+)  and  assume  that  all 
states  are  stable,  that  Is,  q^  ■ -q^  < » (jeS).  If  we  further 
assume  that  { Y ( t ) > Is  the  minimal  process  (and  regular)  corresponding 
to  Q then  the  Pjj(t)  are  the  unique  solutions  of  the  forward  and 
backward  systems  of  differential  equations: 


(7) 


(8) 


Within  this  setting  we  can  use  an  argument  that  parallels  that  used 
for  the  discrete  time  case;  see  [25]  for  example. 

Define  g^(t)  = f^(t).  Then  the  system  (5)  is  completed  by 
the  equation 

Pa»(t)  - « ,,t  ♦ <9> 


(see  [4,  HI. 13])  and  taking  Laplace  transforms  yields 


Paj(0)  ■ + Paa^^aj*9**  U°) 

It  Is  shown  In  [16]  that  p,,(t)  s e"pt  , but  Irreduclblllty  of  S 
means  that  f _(t)  > 0 (t>0)  and  hence  (9)  shows  that  p < q . It 

Bd  d 

follows  now  from  (10)  that  9.,(-p)  < 1 and  g_ _ ( ~p ) « 1 If  S Is 
p-recurrent.  Substituting  (10)  Into  the  Laplace  transformed  version 
of  (8)  and  then  eliminating  p _ _ ( e ) via  (10)  with  j * a eventually 
leads  to  the  system 

+ *'1  jj  • 

which  enables  us  to  deduce  that  g#j(-p)  < ® • Monotone  convergence 


e. 


then  yields 

9,j(-p)  ■ -p'lk^3ak(-»)<ikJ  (JpS) 

If  S Is  p-recurrent.  Thus  { d ^ } Is  a p-lnvarlant  measure  for  Q 
and  hence  for  { Y ( t ) > ; see  Tweedle's  [28]  proposition  2.  The  correspond- 
ing result  for  {f^}  Is  proved  In  the  same  manner  by  starting  with  (6), 
(10)  and  (7). 

3.  THE  LIMITING  CONDITIONAL  A6E  DISTRIBUTION 

We  begin  this  section  by  assuming  that  (Y(t)>  is  as  in  the  early 
part  of  S2,  that  Is,  Is  p-recurrent  and  possesses  the  SRLP.  We  shall 
use  the  normalization  aij  ■ dj  and  ■ iy  Consider  the  distri- 
bution 

. p(r,  < t|»(t)  * j.4,). 

Define  the  taboo  probabilities 

ap1  J ( 1 ) * P(Y(S»“)  t a(p1<s<t),  Y ( t ,u)  » jjAj) 

and  hence  _p4.(t)  =0  If  j ■ a.  It  follows  that 
a i j 

- I P,k(T-t).',kJ<t)/'>U(T)l 

see  [4,  p . 200 ] for  the  case  1 B a.  We  wish  to  let  t-**. 
lemma  and  the  SRLP  yield 

(ni|c/|nj)eptap|cj(t)  < 11m  Inf  (1  - a< j ( t ,t ) ) . 

We  rewrite  the  right-hand  side  of  (11)  using  the  Identity 

■ pkj(t)  ■ |0tp»j(t-u)fk.(u),lu  (^a) 


an 

Fatou' s 

(12) 


(13) 


and  obtain 


1 ” a1  j(  t»T)  * 1 ~ P-fa(T“t)Paj(t)/p1j.  (t)  • 

,tp1k(T't,/p1J(T)J  Ltpaj(t-u)fka(u,du- 


kfa  'o 

Using  Fatou's  lemma  and  the  SRLP  again  yields 


11m  sup  (1-a.j j ( t,x))  s 1 -eptpa1(t)/m 


X-M» 


a jv  y/  j 
E 

kfa 


|*'Pt',aJ(t-u)1,L(mk/"j)fka(u><lu- 


(14) 


However,  using  (13)  again  we  obtain 

e’ptm^  - PaJ(t)  • E m^p,, . ( t) 


kfa  k 

J,"k  apkj(t)  + {0p.J(t-“)kf4”kfka(")<,“ 


kfa 


and  hence  the  left-hand  side  of  (12)  and  the  right-hand  side  of  (14) 
are  equal.  This  proves  the  existence  of 


® j ( t ) » 11m  a1j(t,r) 


1 -4.(W'pt*,,kj<t) 


He  now  proceed  to  show  that  a j ( t ) Is  non-defective  by  obtain- 
ing a more  convenient  representation.  We  have  proved  strict  equality 
In  (14).  The  p-recurrence  shows  that  the  first  term  on  the  right  has 
a Laplace  transform  for  positive  values  of  the  argument  and  hence 
Fublnl's  theorem  gives 

Sj(e)  » ijk'1  paj(e-p)(i+  ^e  mk?ka(9-p))- 


2 


' ' ■ 


i 
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Equation  (6)  yields  ?ka(e)  * Pka ( e)/P##( 0)  and  hence  the  Laplace 
transformed  equations  for  the  p-lnvarlant  measure  yield 

1 + kJ,Vka(9-p)  ■ l/ 

This  together  with  the  Laplace  transformed  version  of  (5)  finally 
yields 

(t)  * m"1  | epugaj(u)du  (15) 

and  hence  a^(t)  Is  an  absolutely  continuous  non-defective  distri- 
bution function  (OF).  We  summarize  our  findings  as 


Theorem  1:  If  { Y ( t ) > Is  p-recurrent  and  has  the  SRLP  then 

a.(t)  = 11m  P (y.  < 1 1 X ( t ) - J.  X(  0)  - 1) 

J T-m. 

exists.  Is  non-defective  and  given  by  (15). 

Theorem  1 bears  an  obvious  resemblance  to  Theorem  1 In  [21]. 
Consider  now  {Z(t),t  > 0},  a regular  minimal  Markov  process  with 
state  space  S * {0,1,...}  for  which  {0}  Is  the  only  absorbing  state 
and  Is  accessible  from  the  Irreducible  set  T * S\{0}.  Let 
lr1j(t)]  denote  the  transition  semi-group  of  (Z(t)}  and  U ■ [u^J 
Its  generator.  We  shall  now  define  the  (elementary)  return  process 
{ X ( t ) } which  will  shortly  play  the  role  of  the  ( Y( t ) } process. 

Let  qoe(0,«)  be  given.  Define  a generator  Q by  q^  * u^leT), 

qoo  * -V  qol  " q0  and  qoj  " 0 ^ * 2,3,...)  and  let  (X(  t)  > be 

the  minimal  process,  necessarily  unique,  constructed  from  Q.  Equi- 
valently, If  X(t)  > 0 the  return  process  evolves  according  to  the 
construction  of  { Z ( t ) } until  It  next  hits  {0}.  It  sojourns  there  for 
a time  which  has  an  exponential  distribution  with  mean  q”1  and  then 


J 
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jumps  to  {1}  and  evolves  as  before. 

Let  the  notation  introduced  for  < Y ( t ) } now  apply  to  the  return 
process  but  with  a » 0.  Clearly 

Foo(t)  ■ «0  Vr10(t-u)<u 

and  hence  solving  (9)  shows  that 

rt  -q  ( t-u) 

p00(t)  * J0e  dFoo(u)  (16) 

where  F (•)  *s  the  renewal  function  generated  by  FQ0(*).  Further 
more 

0P0j(t)  ■ <*<>  f0e  q°  rlj*t"u*du  C Jt°) 

and  hence  from  (16)  and  the  renewal  equation 

* opoj(t)  * 

([4]  p . 189 ) we  obtain 

Poo(0)  3 We)/(Ve)  • 

Poj(9)  * Vlj(6)?oo(e)/(V0)  (j  + o)* 

Since,  however,  9oj(0)  * poj^0^**oo^0^  (jfO)  we  finally  obtain 

9oJ(t)  « qQr ( t)  (JtO). 

Theorem  1 thus  specializes  as  follows  In  the  present  case  and  the 
limit  DF  *j(’)  defines  the  CAD. 

Theorem  2:  If  the  return  process  is  o-recurrent  and  has  the  SRLP 
then  the  CAD,  a^(»),  exists,  is  non-defective  and  given  by 


•j(t)  * | epur1j(u)du/|  epurjj(u)du. 

Its  laplace-Stleltjes  transform  aj(8)  ■ j£*e“et«j(dt)  Is  given  by 
<»j(e)  “ poj(6"p)/poo(0-p)  * ^(e-pj/r^tp). 

Let 

• (Gij(p))"1  | tneptrlj(t)dt 

where  G^tp)  « J eptr^(t)dt  (I.JeT).  The  6^(p)  are  finite. 

This  Is  seen  by  observing  that  rj O * qPj j( t)  and  considering  the 
process  with  transition  probabilities  jjjj(t)  * ePtpl jxj^xi * Clearly 
0P.jj(t)  * ept0Pij(t)xj/xi  and  since  {0}  Is  accessible  from  { j } , 

1 0^1j(t,dt  < ® * see  p.  192.  Let  now 

'O 

61J)(o)  * .1 . »k„_i  > 1 61kj(p)  Gk1k2(p)***Gkn_1j(p) 


(n  > 2). 


Fubini's  theorem  and  the  Chapman-Kolmogorov  equation  yield 


T 
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n-1 


It  is  easily  checked  that  the  Inner  Integral  equals  y ' /(n-1)! 
whence 


u<">  * n!6<3M)(p)/Gu(»). 


Levikson  [19]  gave  a heuristic  derivation  of  this  result  for  the 
case  where  n - 1 and  { X ( t ) > Is  a birth  and  death  process. 

The  hypotheses  of  Theorem  2 are  satisfied  If  the  return  process 
Is  positive  recurrent;  the  limiting-stationary  distribution  Is  given 
by  ^ _ j 

iro  » [j  + J (1  - r1Q(t))dtj  , Wj  - 7r06lj(o)  (JcT). 


4.  MARKOV  BRANCHING  PROCESSES 

In  this  section  we  let  (Z(t)>  be  the  Markov  branching  process 
([3],  Chap.  3)  whose  generator  Is  given  by  u^j  » + i ( 1 + J ) 


and  u44  * - Z u..  where  \>  > 0 , p.  > 0 
11  kfl  1k  J 


» E p.  * 1 . o < p < 1 
j>0  J 0 


and  pj  ■ 0.  As  Is  well  known  Z(t)  represents  the  size  of  a popu- 
lation of  Individuals  whose  lifetimes  are  Independent  and  exponentially 
distributed  with  mean  v"*,  and  at  the  end  of  Its  lifetime  an  Indi- 
vidual produces  j progeny  with  probability  j.  All  Individuals 
reproduce  Independently.  Clearly  T Is  Irreducible  and  {o}  Is 

accessible  from  T since  p„  > 0.  We  shall  use  the  notation 

o 

G,.  = G..(o)  and  f(s)  * Z p.s^.  Regularity  of  the  Markov  branch- 
1 J JeS  3 

(l 

Is  equivalent  to  the  condition  j ds/(f(s)-s)  ■ • 

Jl-e 


ing  process 


for  each  e 1n(0,l-q)  where  q Is  the  probability  of  eventual  absorp- 
tion when  Z(o)  ■ 1 and  Is  the  least  positive  root  of  the  equation 
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f(s)  » s.  Let  m ■ f * ( 1 - ) . 

We  now  determine  when  the  hypotheses  of  Theorem  2 are  fulfilled. 
If  m < 1,  q «-  1 and  when  m < 1 the  expected  time  to  absorption 
Is  finite  and  In  this  case  the  return  process  Is  positive  recurrent. 
Furthermore,  r^(t)  S 1 - r1Q(t)  * A * v(m-l)  < 0 [33]  and 

hence  the  CAD  has  moments  of  all  orders.  If  m ■ 1 the  return  pro- 
cess is  recurrent  and  the  expected  entrance  time,  T , to  {0}  from  {1} 

Is  finite  Iff  [*(  1 -s ) / (f (s) - s)ds  < • . Thus  when  this  Is  the  case 
Jo 

the  return  process  Is  positive  recurrent. 

Consider  now  the  case  for  which 

f(s)-s  ■ (1-S)*L((»-*)_1) 

where  L(  ) is  slowly  varying  (SV)  at  Infinity.  If 
( dx/xL(x)  » » then  E(T)  « » and  this  condition  Is  satisfied  In 

Jo 

the  important  special  case  where  y » f ' ’ ( 1 - ) / 2 < • . As  Is  well 
known  [3]  the  backward  equation  for  {Z(t)>  can  be  Integrated  and  In 


parti cul ar 


’rm( 


du/a(u)  * t 


w 

1 1 

where  a(s)  ■ v(f(s)  - s)  and  If  V ( t ) ■ j dx/L(x)  , (17)  becomes 
Now  V ( - ) Is  strictly  Increasing  and  -t / L ( t ) (t-**»)  and  hence  we 


find  that 


1 - r1Q(t)  * l/vtM( vt) 


(18) 


where  M(*)  Is  SV  at  Infinity  and  satisfies 

M( t)/L (tM(t))  -*•  1 , L(t)/M(t/L(t))  •*  1 (t-*«).  We  now  show  that 


J 
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1 " Foo(t)  ~ 1 ' r10(t)  (t— )•  (19) 

This  follows  by  observing  first  that  FQ0(t)  1*  the  convolution  of 
•q  t 

the  DF's  1 - e 0 and  r1Q(t)  whence  the  Inequality 
(1  - r10(f)  * e'<,°t  )(»-*)  i 1 - Foo(t> 

i (1-  r10(f,)*t'"«*")(l»c) 

where  t‘  * (l-6)t,  t‘ ' * (l+6)t,  0 < 6,  c < 1 and  the  Inequality 
holds  for  all  t sufficiently  large;  see  [8,  p . 278] . Since 

e q°^(l  - rlQ(t))  •*  0 (t-*»)  (19)  readily  follows.  Let 

m ( t ) ■ [ (l  - F (u))du.  It  follows  from  (18)  and  (19)  that  «(•) 

)Q  oo 

Is  SV  at  infinity  and  hence  we  can  apply  a renewal  theorem  of  Erickson 
[61  to  (16)  and  obtain 

p00(t)  “ l/q0«n(t)  (20) 

Thus  (3)  is  satisfied  with  p » 0 and  hence  the  conditions  of 
Theorem  2 are  again  fulfilled.  When  y < *•  L(x)  ♦ y (x-*»)  and 
(20)  becomes 

P00(t)  ~ VY/qo  109  1 

which  Is  Implicitly  contained  In  (31).  Finally  we  mention  that  when 
m - 1,  u<J>  < - Iff  E ( T)  < -. 

Consider  now  the  case  where  m > 1.  Stewart  [27]  has  shown  that 
the  function 

g(0)  « e[l  ♦ qQ  Jo e " 0 1 ( 1 - r10(t)}dt] 

exists  and  Is  strictly  Increasing  for  e > d * max(-qQ(l-q) , a'(q)), 
d < 0,  and  there  exists  pc(0,-d)  such  that  g(-p)  ■ 0.  He  then 
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shows  that  (X(t)>  Is  p-posltlve  and  hence  Theorem  2 applies  here  also, 
Moreover,  It  Is  known  [3,  p . 115]  that  rjj(0  * 0(e"8t),  6 ■ -a'(q) 
and  hence  we  see  that  < • (n  « 1,2,...). 

Let  G . ( s ) » “ G. .s^  and  F.(s,t)  » " r..(t)s^. 

1 j-1  1J  1 J-0  1J 

Using  Fublnl's  theorem  and  the  forward  equations  for  { Z ( t ) > we  obtain 


G1 (s)  - | (Fi (s,t)  - Fi (0,t)) dt 

* [ f F'.(x,t)dxdt 
Jo  Jo 


where 


F'^s.t)  - O/asJF^s.t) 


|o  | (0/3t)F1(x.t))/a(x)dxdt  (21) 

f (qi-x1)/a(x)dx  < • (0  < s < 1). 

Jo 


Now  let  m s 1 and  G^(s)  ■ j g!^s^  and  observe  that 

j-1  1J 

G * Gj(l-)  < « If  either  m < 1 or  m ■ 1 and  E(T)  < * since 
G » ET.  For  these  cases  use  of  Fublnl's  theorem  and  (21)  yield  the 


rel atlon 


G(2)(s)  » j*(G  - G1(x))/a(x)dx 

• f (l/*(x))  f ( l-y)/a(y)dydx. 
Jo  Jx 


This  allows  us  to  compute  Wj  In  principle. 

Let  A(j)  be  the  limiting  conditional  age,  that  Is,  It  Is  a ran- 
dom variable  whose  OF  Is  the  CAD.  We  shall  now  obtain  some  limit 
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theorems  for  A ( J ) for  large  j.  It  Is  known  [3]  that  { Z ( t ) > has  an 
Invariant  measure  { u j • j*l,2,...}  whose  generating  function  Is  given 
by 

U(s)  - i u.sJ 
J-l  J 

- ( dx/a( x)  (s  < q). 

'o 

It  follows  from  (21)  that  G . ( s ) ■ ( (q* -x^ ) U* (x)dx  and  Integration 

1 'o 

by  parts  yields  the  representation 

61j  " quJ  - uj-1  + 1uJ-1/j 

where  we  employ  the  convention  Uj  * 0 ( J*0,-l,-2 , . . . ) . Now  let 

m = 1 and  write  the  last  equation  as 

■ Juj  • 

When  y < • Y#ng  (321  has  shown  that  jUj  - 1/vy  «nd 

hence 

6^  ~ 1/vyj  ( - (22) 

At  this  point  It  Is  worth  observing  that  if 

f(s)  - s * ( 1-s) 1+nL  (( 1-s) _1)  where  0 < n < 1 and  L(*)  Is  S V at 
Infinity  then 

GU  “ </vr(n)j2"T,Uj)  (j~). 

This  follows  on  observing  that 

1-s1 

G'(s)  ' Tm'Hi-triTj)  • 


where  W(s)  ■ (l-f(s))/( 1-s ) Is  a probability  generating  function, 
and  this  gives  the  representation 
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where  * v.s^  ■ 1/(1 -W ( s ) ) . Our  assertion  now  follows  by  invoking 
j-0  3 

appropriate  renewal  theorems;  details  may  be  found  In  [23]. 

2 

He  now  assume  that  1 » 1 and  also  that  £ p.j  log  j < •. 

jkl  3 

The  latter  assumption  allows  us  to  Invoke  a local  limit  theorem  [5] 
which  states  that  If  a • vy  then 

o2t2(exp( j/at))ri j(t)  ♦ 1 

as  t,j-*«  but  such  that  j/t  Is  bounded.  Using  this  result  with 
(22)  shows  that  If  j/t  ■ 0(1)  (j-*~)  then  can  b*  re- 

placed  by  (j/ot2)e“^at  with  negligible  error  as  j-*»  and  hence 

Gjj  | rjj(s)ds  - (J/o)  j^e~J/osds/s2  - 1 - e"1/ot. 

Thus  we  have  the  following  analogue  of  Theorem  2 In  122] . 

2 

Theorem  3:  If  m » 1,  £ p,J  log  j < • and  o ■ vf"(l-)/2  then 

j*l  J 

11m  P (A( j ) < jt)  ■ exp(-l/ot)  (t>0). 

J— 

For  the  case  1 < m < • we  need  to  review  some  well-known  facts. 

There  Is  a function  c(t)  (0<t<«)  satisfying  c(t)  f 

c( t+x ) / c ( t ) * eAT,  A - v(m-l),  (t— , t>0)  and  If  Z(0)  - 1. 

Z(t)/c(t)  W,  a non-defective  random  variable  whose  DF  has  an 

atom  of  size  q at  the  origin  and  Is  absolutely  continuous  with  a 

positive  density  function,  w(*)»  on  the  set  of  positive  numbers. 

If  £ p.j  log  j < - we  may  choose  c(t)  ■ eAt;  see  [3],  [20]  and 
j*l  J 

[33].  With  this  notation  we  shall  prove  the  following  result. 


Theorem  4:  Let  1 < m < •,  f"(l-)  < - Ml  -•  < Xj  < xg  < ».  Then 


, fexp(-x.)  ,. 

P(x.  < AA(j)  - log  j < x?)  M 1 1 t P/Pw(t)dt 

1 c Jexp(-x2) 


(j— ) 


,00 

where  M * I t”p^Aw(t)dt. 

J ft 


This  theorem  Is  analagous  to  the  discrete  time  version  In  [221 
except  that  in  this  reference  j-*»  through  a lacunary  subset  of  the 
positive  integers.  The  main  component  of  the  proof  is  the  determina- 
tion of  the  behavior  of  Gjj(p)  when  J *s  Iar9e*  In  the  following 
proposition  p can  be  any  number  such  that  0 s p < m1n(5,A)  al- 
though in  our  use  of  the  proposition  p will  be  the  convergence 
parameter,  which  < 6. 


Proposition . Let  1 < m < <■•  Then  (i)  if  { p j > is  aperiodic 

j Gj j - (l-q)/A 

and  (11)  If  0 < p < m1n(6,A)  and  £ p*j  log  j < • then 
j>l  J 

J1-p/AG1j(p)  A”1  | t_p/Aw(t)dt  < «. 

Proof.  (1)  Equation  (21)  yields 

GJis)  * (q-s)/a(s)  - l/v(l-w(s)) 

where  w(s)  ■ (f(s)  - q)/(s-q)  Is  a probability  generating  function 
and  w'(l-)  * (m-l)/(l-q).  The  assertion  now  follows  from  the  dis- 
crete renewal  theorem  [7]. 

(11)  We  will  derive  two  representations  for 

G(p,s)  - £ G..(p)sJ.  The  first  will  give  us  the  asymptotic  behavior 

J-l  1J 


20. 


of  G(p,s)  as  s+1  and  the  second  will  allow  us  to  Infer  the  desired 
result.  First  observe  [3J  that  (Fj(s,t)  - q)  - h(s)e“fit  (t-**>) 
where  h ( • ) Is  finite  for  0 < s < 1.  Application  of  Fublnl's 
theorem  then  shows  that  G(p,s)  < • If  0 s s < 1.  Let  q < s < 1. 
Observing  that 

G(p»s)  - | ept(F1(s,t)  - q)dt  ♦ j ept(q  - F1(0,t))dt 


makes  It  clear  that  It  suffices  to  consider  the  first  term  on  the 
right,  H(p,s),  In  order  to  obtain  the  asymptotic  behavior  of  G(p,*). 
Proceeding  as  In  (21)  we  obtain 


H(p,s)  ■ | dx/a(x)  |*ept(3/3t)F1(x,t)dt 

* f ((q-x)/a(x))dx  - p(  (H(p,x)/a(x))dx 
> a J a 


(23) 


where  the  second  equality  follows  from  Integration  by  parts  of  the 


Inner  Integral  which  can  be  written  as  j eptdt(F1(x,t)  - q) . 

Differentiation  of  (23)  yields 

(3/3s)H(p,s)  ■ (q-s)/a(s)  - pH(p,s)/a(s) . (24) 

Choose  soe(q,l)  and  let  V(s)  ■ exp  p|  dx/a(x).  Observe  now  that 

so 

for  s - q small  enough, 

a(s)  * -l/6(q-s)  + 0(1). 

It  follows  that 

v(s>  - K(s-q)-(,/5  (s*q)  (25) 

where  0 < K < « and  hence,  since  p < 6,  ¥(•)  Is  Integrable  over 
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[q,sj,  q < s < 1.  Equation  (24)  can  now  be  solved  In  the  standard 
way: 

H(p,s)V(s)  - - f (( x-q)/a( x)) V(x)dx.  (26) 

Now  use  the  fact  that  V(x)/a(x)  - Y'(x)/p  and  (25)  to  Integrate  the 
right  hand  side  of  (26): 

H(ptS) V(s)  - -( s-q)  V( s)/p  + p_1  [q$V(x)dx. 

Letting  f*(s)  - (»-l)/ (f(s)  - s)  ♦ (1-s)-1  we  have 


l/a(s)  - -1/A( 1-s)  + A_1f*(s) 


and  moreover 


f f*(s)ds  < - (q  < s < 1)  Iff  £ p,j  log  j < - 

>s  JU  3 


[3,  p. 117) . Thus  we  obtain 


V(s) 


1-s 


l1_So 


p/A 


exp((p/A)  | f*(x)dx) . 


Let  4(0)  - E(e"0W).  Using  equations  (7)  and  (11)  In  [3,  pp. 116-117), 
we  obtain  the  representation 

fS 

yq 

and,  as  Is  shown  In  [3,  p.116]. 


H(p.s)  * -p_1( s-q)  + p"1  fSl4-1(x)/d“1(s)]p/Adx 


♦_1(s)  » (1-s)  exp  - | f*(x)dx  . 


It  Is  now  apparent  that 

G(p.s)  - p‘1(l-s)'P/A 


'0 


p/A 


dx 


and  the  Integral  Is  finite.  Making  the  change  of  variables  x » 4(0) 
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In  the  integral  shows  that  it  equals 

- ( ep/A$ 1 ( e ) de  = f ep/Ade  f te"etw(t)dt 
J O '0  -'o 

,oo 

* r ( 1 + p/A)  j t-p/Aw(t)dt. 

When  0 s s < q the  procedure  leading  to  (24)  yields 

(3/3s)G(p,s)  = (q-s)/a(s)  + pG(p,q)/a(s)  - pG( p ,s ) /a ( s ) , 


that  is 

v(3/3s)G(p»s)  - (l  + pG(p,q)/(q-s)  - pG( p ,S )/ ( q-S )) / (1  - w( s ))  . (27) 

oo  f 

Let  E v.sJ  = 1/(1  - w(s))  so  that  {v./v  } is  a renewal  sequence; 
j = o J J 

v * 1 - p /q  > 0 and  we  know  that  v.  -»-v  * (l-q)/(m-l)  (j-*-*). 

o o ^ j 

Writing  g4  - EG,  , + lf(p)qk  it  Is  apparent  that 
J kcS  K 

(G(p,q)  - 6(  p , S )) / ( q-S ) * q’1  (0  i S < 1) 

and  hence  it  follows  from  a Tauberian  theorem  for  power  series 
((8],  p.447)  and  the  results  above  that 

Z 9k  - (q/v(l-q))[  £Vp/Aw(t)dt]jp/A. 


However 


3 

vjGu(p)  • »j  * (P/0)k£o*k9j.k 


and  it  is  easily  shown  that 

j 

= 9, 


f J 

1 Vj-k 
k=o  * J K 


At 


v. 


see  (10,  p.42J.  This  completes  the  proof. 
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To  complete  the  proof  of  this  theorem  we  use  a local  limit  theo- 
rem [2]  which  states  that  when  f'(l-)  < °°  and  j,t-*-®  in  such  a 


-At 


way  that  o < Cj  < je  - c2  < 


then 


rij(t)  = e-At[w(je~At)  + o(l)]. 


This  shows  that 


j-A'^x,  + log  j) 


fA_1(x2  + log  j) 


epSr..(s)ds  - 


-1, 


A (xj  + log  j) 


lj 


A"1(xj  + log  j) 


e(p-Msw(je-As)ds 


^-lj-d-p/A) 


/•exp(-x1) 


t_p/Aw(t)dt 


exp(-x2) 


and  the  theorem  follows  Immediately. 

We  consider  now  the  case  m < 1 and  assume  that  the  radius  of 
convergence  of  Ip^s^  Is  sufficiently  large  for  the  existence  of 
a > 1 such  that  f(o)  ■ a.  It  is  easily  seen  that 


F(s,t)  ■ F^so.tJ/o  is  the  probability  generating  function  of 


{ r 1 j ( t ) } which  defines  a super-critical  Markov  branching  process 


with  lifetime  mean  v~*,  offspring  mean  f’(o-)  s • and  extinction 

-1 


We  thus  have 


'lj 


'ljr1'1  . r , j ( t)  * ?u(t)qJ-1  . 


probability  q * o 
G! 

Assuming  that  f'(cr-)  < «°  * the  proposition  shows  that 
jcr^Gij  -*•  (a  - l)/v(f(o-)  - l) 


and  the  following  theorem  follows  easily: 


"i  ' ""u 
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Theorem  5:  If  m < 1,  f''(a-)  < ",  --  < Xj  < < - and 

0 • v(f(o)  - 1)  then  .«xp(-Xj> 


11m  P(xj  < DA ( j ) - log  j < x2)  ■ (l-o  ) 


lx-1 


j 


w(t)dt 


Jexp(-x2) 


where 


* cc 

e~0tw(t)dt  + o - 1 * 11m  F (exp( -0e~Dt)  ,t) . 
Jo  t-*<» 


Example:  We  let  (Z(t)}  be  the  linear  birth  and  death  process  with 
positive  birth  and  death  rates,  X and  y respectively.  Here 
v = X + y,  m » 2 X/v,  A 3 X - y and  when  m > 1,  q * y/X  and 
6 * A.  In  this  case  w(t)  * (1  - y/X)e_t  and  the  density  of  the 
limit  distribution  of  Theorem  4 Is 

(r(l-p/A))‘Vx(l'pM)  exp(-e"x). 

When  m < 1 the  dual  process  exists  and  Is  the  linear  birth 

and  death  process  with  birth  rate  y and  death  rate  X.  It  follows 
that  the  limit  distribution  of  Theorem  5 Is  the  extreme  value  distri- 
bution whose  DF  is  exp(-e~x).  The  occurrence  of  extreme  value 
distributions  when  X s y Is  not  surprising  In  view  of  the  fact 
that  {Z(t)>  Is  a reversible  process  and,  as  shall  be  seen  in  S5,  the 
CAD  is  the  same  as  the  extinction  time  distribution  when  Z(o)  ■ j. 
However  It  follows  from  the  Independence  of  family  lines  that  this 
latter  distribution  is  that  of  the  maximum  of  j Independent  copies 


where  r * X/u,  and 


ft(F1(s,x)  - F^o.t))  dx  * (( l-r)/Ar)  log  [1  - rs(l-e-t)/(l  - reAt)]. 
'0 

Thus  G^.  = (Xj)_1rj  and 

aj ( t)  = [(1  - eAt)/(l  - reAt)]j. 

This  yields 

ujl)  * | (l-aj( t))dt 

- -((l-r)/A)  Z I rn(k+l+n)_1 

k*o  n=*o 

- -A-1  log  j . 


When 


U,  Levikson  [19]  has  shown  that 


aj(t) 


c 


Ihl 


j 


o (1+Xy) 


3+T 


ii. 


When  X > y evaluation  of  the  relevant  integrals  Involves  hyper- 
geometric  functions  and  is  not  very  revealing.  The  equation  for 
can  be  written  as 


q0  + P 


1 ( t)dt 


P 


■'o 

which  In  principle  can  be  numerically  solved.  Finally  when  X < u 
It  is  known  that  the  limiting  distribution  of  the  return  process  Is 
a logarithmic  series  distribution  [30]. 


5.  BIRTH  AND  DEATH  PROCESSES 

In  this  section  we  study  the  birth  and  death  process  {X(t)>  with 
birth  and  death  parameters  0 < < °*  (J£5)  an<*  0 < uj  < " (J£T), 


26. 


c 


I 


respectively.  Let  ttq  * 1 and  it  j » (XQXj. . .Xj_1)/(u1y2*  • *Wj)  • 
It  Is  known  (111,  [12]  that  if 


E (it.  ♦ 1/A.ir.)  » • (28) 

J«o  3 J J 

there  is  exactly  one  standard  substochastic  transition  semi-group 
whose  generator  Is  given  by 

' ’(XJ  * V*  ‘ 0) 


’j.jtl  " X3  (JcS) 

’ “3  (JeT) 

and  * 0 If  |i  - j|  > 1 and  which  satisfies  the  forward  and 

backward  systems  of  differential  equations  and  also  the  Chapman- 
Kolmogorov  equation.  If  also 

I (A.ttJ"1  E it.  » « (29) 

j.O  J J 1*0  1 

then  [p^j(t)]  is  stochastic.  We  shall  always  assume  that  (28)  and 
(29)  are  In  force. 

Clearly  { X ( t ) } Is  a return  process  obtained  from  the  process 
{ Z( t ) } with  the  generator  defined  as  above  except  that  \Q  * 0,  which 
renders  (0)  absorbing  for  { Z ( t ) } . As  before  let  (rjj(t)>  denote  the 
transition  semi-group  of  (Z(t)};  it  Is  stochastic. 

We  shall  show  that  the  CAD  always  exists  but  is  non-defective  Iff 
■C X ( t ) } Is  p-recurrent.  But  first  we  must  discuss  the  p-classl flcatlon 
of  (X( t) } and  this  is  most  conveniently  done  In  terms  of  the  spec- 
tral representation  of  its  transition  semi-group. 

Associated  with  Q Is  the  system  of  polynomials  { Q j ( x ) > defined 


A 


and  hence  we  call  ♦ the  spectral  measure  of  the  process.  We  shall 
need  the  following  properties  of  the  Q j ( • ) : Qj(o)  * 1 (jeS)  and 
If  x < 0,  1 - Qq(x)  < Qj ( ^>  < ...  < Qj(x)+» 

See  [111  for  details. 


Let  p be  the  smallest  point  In  the  support  of  ♦ ; 0 < p < • 

and  In  addition  let  $ be  the  measure  defined  by 
♦(E)  3 ♦( E ♦ p),  Ee[0,»J.  Clearly 

P00(t)  - «'pt  JVtx*(dx) 

and  hence  for  any  e > 0 we  have  the  Inequality 

0 < e‘(p+e)S([0,e])  < P00(t)  < e"pt. 

(t-*-)  and  hence  p Is  the 


28. 


convergence  parameter  of  S.  Furthermore  Fublnl’s  theorem  shows  that 


S Is  p-translent  Iff 


< 00 


[ x_1*(dx) 

* o 

<p({0>)  > 0,  but  p-null  If  4>( {0> ) - 0 but  £ x_1*(dx) 


and  Is  p-positlve  If 

®.  These 


results  were  obtained  for  the  case  p * 0 In  112].  In  this  case  It 
was  also  shown  that  {tt^}  Is  always  an  Invariant  measure.  The  follow- 
ing theorem  extends  this  result. 


Theorem  6:  The  sequence  ("jQj(pH  Is  a p-invarlant  measure  and 
(Qj(p)}  Is  a P-invarlant  function  for  < X ( t ) } . 


Proof.  From  the  theory  of  orthogonal  polynomials  It  Is  known  that 
Qj(p)  > 0 and  consequently  we  can  define  the  polynomials 
Rj(x)  ■ Qj(x+p)/Qj(p) . Let  Cj  • XjQj+j(p)/Qj(p)  (JeS)  and 
Wj  * wj^j-l(p)/Qj(p}  (JeT).  These  define  a generator  R.  It  Is 
easily  seen  that  {Rj(x)>  Is  generated,  according  to  the  prescription 
(30),  by  the  sequences  (c^)  and  {w^}.  Furthermore  (31)  shows  that 
(Rj(x)>  Is  orthogonal  with  respect  to  <|>.  The  construction  can  be 
reversed,  that  is.  If  $ Is  another  measure  such  that  { ( x ) > Is 
orthogonal  with  respect  to  4>  then  (Qj(x)}  Is  orthogonal  with  respect 
to  ^ where  <j>(  (0,p) ) ■ 0 and  5>(E)  * $(E-p)  if  E Ip,®].  How- 
ever (28)  implies  that  ^ Is  the  unique  solution  of  the  Q-moment 
problem  and  hence  t is  the  unique  solution  of  the  R-moment  problem. 
It  follows  that  If  Mj  » ir j Qj ( p ) then 

Pi j ( t ) - Mj  jf  e"xtR1  ( x ) Rj ( x) ♦( dx)  (32) 


defines  a substochastic  transition  semi-group  and  In  view  of 


29. 


Theorem  16  of  [11]  this  semi-group  is  stochastic  iff 


? U.M.)’1  E M - 
j«0  J J 1»0  1 


Suppose  this  Is  not  the  case.  It  then  follows  from  Lemma  6 of  [11] 
that  11m  R . ( x ) < « (x<0).  Choose  x a -p.  Then  It  follows  that 


lim  Q.(p)  > 0 and  hence  that  (29)  Is  violated,  a contradiction. 

3 

From  the  definitions  above 

i^jU)  =*  (Qj(p)/Q1  (p))eptpi j ( t ) 

and  the  condition  I p4<(t)  * 1 Implies  that  {Q.(p)}  is  a p-lnvarlant 

j*0  3 

function  of  {X( t ) } . Furthermore  {M j } Is  an  Invariant  measure  for 
tP7-j(t)]  and  hence  < it ^ Q ^ ( p ) } Is  a p-invarlant  measure  for  (Pjj(t)]* 

The  proof  also  shows  that  Qj(p)+0  (j-*«).  When  (X(t)}  Is 

p-translent  the  constructions  In  52  show  that  (m^)  and  (x^}  are 
strictly  p-sublnvarlant.  Thus  a p-translent  birth  and  death  process 
has  (at  least)  two  distinct  p-subinvari ant  measures  (functions);  see 
[16,  end  of  §3].  It  also  follows  from  §2,3  that  when  S Is 


p-recurrent , 


W'p)  ■ \>GUlp)  ' *JQJ(p) 


In  the  p-transient  case 
*oGlj(p) 


poj(-p)/poo(-p) 

f%  (x)x_1*(dx) 

’jVp>  V 


♦ (dx) 


T 


j 


and  the  Integral  In  the  numerator  Is 


Sj  * VkQk(p)Qk+l(p)1  1 ; 


see  [12,  59. AJ.  The  series  is  finite  Iff  S Is  p-translent. 


Thus  we  have 


S 1 j (p)  - x0lirjQj(P)(l  ■ aj/S0) 


j-1 

where  Oj  * E * Th1s  exPress1on  1s 


cases. 


It  Is  shown  In  [12]  that 


P1  j(t)/pk1(t)  ♦ Q1(p)Qj(p)wj/Q|((p)Q1(p)w1  (t-M.). 

For  s > 0, 

P0o(t+T)/poo(t)  * e’PT(1  " H) 

where 

H . (1  . e-TCx-t>))^(<Jx)/pe-t(x-0)1Ji(<lx, 

and  It  follows  as  In  [12,  p . 389]  that  H-0  (t~).  Thus  the  birth 
and  death  process  { X ( t ) ) always  has  the  SRLP. 

The  manipulations  In  53  carry  through  here,  but  with  some  changes 
In  the  p-translent  case  and  we  find  that  the  CAD  always  exists  and 

•j<‘>  ■ ((Slj(p))-l{VSr1J(0<is](l  - Oj/S0)- 

In  particular  we  see  that  In  the  p-translent  case  the  CAD  Is  defective 
and  that  P(A(J)  * »)  ♦ 1 

The  reversibility  of  {X(t)),that  Is,  a 

Implies  that  when  the  process  Is  recurrent,  A(j)  has  the  same  dis- 
tribution as  that  of  the  first  passage  time  from  {j}  to  {0}.  This 


31. 


fact  Is  exploited  In  the  context  of  diffusion  processes  In  129]. 
Finally  we  mention  that  in  the  p-recurrent  case  the  proof  of  Theo- 
rem 6 shows  that 

e(«'8,(j)]  • jYetjSoJ(t)dt  /nj  f"e’etp00(t)dt  . 

0 *0 

that  Is,  we  can  work  in  terms  of  a recurrent  process  which  has  the 
same  CAD.  The  preceding  remark  shows  that  In  principle  It  suffices 
to  consider  only  the  recurrent  case  in  seeking  limit  theorems  for 
A ( j ) for  large  j.  In  particular  It  Is  necessary  to  be  able  to  find 
the  asymptotic  behavior  of  {Qj(p)}  In  order  to  find  that  of  { c j > and 

{wj}* 

We  shall  now  obtain  a variety  of  limit  theorems  for  A(j)  with 
attention  being  confined  mainly  to  very  specific  examples  which  are 
of  common  occurrence.  We  shall  also  see  that  sometimes  it  Is  more 
convenient  to  work  with  the  return  process  and  at  other  times  with 
the  absorbing  process.  In  the  sequel  the  symbols  ( * ) * I v ( • ) and 
*v(*)  will  always  stand  for  Bessel  functions. 


(i)  M/M/1  queue.  Here  Aj  * X (jeS)  and  yi^  ■ u (jcT). 

r * A/u.  It  Is  well  known  that  the  return  process,  that  is 


Let 

the 


queue  length  process.  Is  positive  recurrent  when  r < 1,  null  when 


r = 1 and  transient  when  r > 1.  In  fact  when  r > 1 the  spectral 
measure  has  a density  which  Is  supported  on  a finite  interval  bounded 


away  from  the  origin  [13]  and  hence  S is  p-translent.  We  shall  con- 
sider only  the  case  r s 1.  Clearly  6^  « A_1rj  and  It  Is  known 
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see  [9].  Using  the  transform  relation 


| e”6xI j (ax)dx  ■ a“j(e  - (e2-a2)1/2) J(e2-a2)'1/2 


it  is  an  easy  matter  to  prove 


Theorem  7;  If  r < 1 then 


p(A(j)  s jx)  -*■  1 - exp(-x/(u-A))  (x  > 0) 


and  if  r » 1 then 


P(A(j)  < jZx)  - F1/2(Ax) 


(x  > 0) 


where  Fj^2(x)  the  stab^e  DF  index  1/2  whose  density  is 
fl/2(x)  * (2Ux3)1/2)  1 exp(  -l/4x)  ( x > 0) . 

(ii)  M/M/a>  queue  or  immigration-death  process. 

Here  Aj  = 5 and  yj  * yj  (jeS).  The  return  process  is  always 
positive  recurrent  and 


$(s,t)  = ? p .(t)sJ 


* exp[-c(l-e"ut)(l-s)) 

where  c ■ 6/y  and  Gjj  * c3/Aj!  . 

By  taking  the  Laplace  transform  of  (34)  we  obtain 


(34) 


and  hence 


p0j(8)  - (wj: )_1  j,ys/"‘Vc(1'y)rc<i-y)iJ( 

J-9/U  /JK»/W-leCX/J(1_x/J)Jd)c 

a.(Q)  - 4 

y^’V'dy 

1 n 
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whence 

Theorem  8: 

P(A(j)  - 

where 

♦ (0)  ■ 

m 

-1 


( -ao<x<oo) 


r(e/u)  / y0/y'1ecydy 


( 6>0) . 


Integration  by  parts  yields 

r ( i ♦ e/y) 


4.(8) 


:c-c  f 


ye/Vy<ly 


(35) 


and  It  Is  now  clear  that  <fr(8)  Is  a non-defective  moment  generating 
function;  the  requisite  continuity  theorem  can  be  found  In  [21].  Now 


r ( 1 + 0/y)  * | e"0xdV(x) 


where  V(x)  * exp(-e"MX)  Is  an  extreme  value  DF.  Moreover  the 
derivative  of  the  denominator  In  (35)  Is  completely  monotone  and  hence 
It  follows  [8,  p . 44 1 ] that  the  reciprocal  of  this  denominator  Is  the 
Laplace-Stleltjes  transform  of  a DF,  W(x)  say,  and  W(0+)  * 0.  This 
gives  the  representation 

F(x)  = f V(x-y)dW(y). 

'o 

(111)  Null  recurrent  linear  bi rth-death-1 mml gratl on  process. 

Here  Aj  = Aj  ♦ 6,  y^.  = yj  (jeS).  The  theory  of  Markov  branch- 
ing processes  with  Immigration  [20]  shows  that  S Is  positive  recur- 
rent when  r * A/y  < 1,  null  if  r B 1 and  6 s A,  transient  If 
r ■ 1 and  6 > A and  6(l-r"*)  - positive  If  r > 1.  We  shall  con- 


(■ 
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fine  our  attention  to  the  null  case. 

It  Is  easily  shown  that 

4(s,t)  = " Pft1(t)sJ 

j»0  0J 

• (1  + xt(l-s))"fi/x  . 

We  first  consider  the  boundary  case  6 ■ X.  Then  [1»  p . 1029] 

P00(e)  * x"1ee/AE1(e/x) 

where  Ej(«)  Is  the  exponential  Integral  [1,  p.228]  whence  [1,  p . 229] 


Poo(0)  * X_1  l09  e_1 


(0+0) . 


(36) 


The  spectral  measure  has  density  x“*e~x^X  (x>0)  and 
Qj (x)  ■ Lj(x/X)  where  Lj(*)  Is  a Laguerre  polynomial;  see 
[14,  p.652].  Making  use  of  the  integral  representation  [1,  p.785] 

Lj(x)  « ( j I ) ”1ex  | e'ttJJQ(2(tx)1/2)dt 


we  obtain 


Poj(e)  • (yxj:)  { 


fV\J 

> J (2(ux/X)1/2) 

— dx 

Jo 

Jo  0 + X 

L 

dy 


2ir  ^ foo  ..  J f r«o  yJQ(y) 


Xj 

2ir 


dy 


t f .".J  f -i- 

* Jo  Jo  y^  + 40u/X 

| e’uujK0(2(6u/X)1/2)du  . 


du 


Substitute  0/n^  for  0 where  0 < n j / j -*•  and  denote  the  result- 
ing coefficient  of  tt ^ by  C^.  Choose  e > 0 and  break  the  range 
of  Integration  into  the  sets  [O.enj]  and  [en^.,*)  and  write 


Cj  * Cjj  + Cgj.  Since  KQ(»)  is  non-increasing 

f oo 

C2j  - (2/M:)K0(2(8c/X)1/2)  j e"uujdii 


L enj 


e-j(v-l) 


r^dv 


We  shall  choose  n^  ■ j1  v,  v>0  and  it  is  not  difficult  to  see  that 
0[-J  -*•  o (j-*»)  by  observing  that  * 0((j+k)! 

and  choosing  kv  > 1 . 

By  choosing  e small  enough  we  can  replace  Kq  (2(8u/Xn^) 
in  Cjj  by  log  (( Xn  j/0u ) 1//2/2)  with  arbitrarily  small  relative  error. 
This  yields 

Cjj  ^ ((log  n j ) / X j 1 ) | ^ e‘uu^du  - (Xj!)"1  j ^(log  u)u^e~udu. (37) 

The  first  term  ^ x“*  log  n^  and  the  argument  used  above  yields 

f<*> 

ji  (log  u)uJe'udu  = o(log  j)  (j-*«). 
enj 

Now 

f u^e"u  log  u du  * r'(j+l)  'v  j!  log  j (38) 

Jo 

[1,  pp. 257-259)  and  using  (36)  - (38)  we  find  that 
aJ(0j"1"v)  ♦ v/(l+v)  ( v>0) . 

The  limit  Is  the  Lap! ace-Stlel tjes  transform  of  a distribution  con- 
centrating mass  v/(l+v)  at  the  origin  and  no  mass  in  any  finite 
Interval  bounded  away  from  the  origin.  Thus 

P(A(j)j-1'v  5 1)  - v/(l+v) 


36. 


and  the  following  result  now  follows. 


Theorem  9:  For  the  linear  bl rth-death-lmml oration  process  with 


A = u * 5, 


P(log  A(j)  < jx)  ♦ ( 1 -x “ 1 ) ^ 


In  dealing  with  the  case  6 < A we  can  expand  our  scope.  Con 
slder  a general  birth-death  process  for  which 

iTj  'v-  Dj*"1,  (AjUj)-1  * Cj0"1 

where  C,D,0,y  > 0.  Let  a » 0/(B+y).  It  is  shown  in  [15]  that 


Qj(xj“®”Y)  - r(l-a) 


a +y 


2(CDx] 


0 + Y 


- N(x),  say 


pointwlse  for  x > 0 and  uniformly  in  compact  subsets  of  [ 0 ,«** ) . It 
is  also  shown  that 

P00(e)  -v  H9"a  (0+0), 

where  H is  a positive  constant,  and  a Tauberian  theorem  for  Stiel- 
tjes  transforms  (e.g.,  the  dual  version  of  Theorem  2 in  [26,  p . 6 1 ] ) 
shows  that 

*(x)  * (H/r(a)r(2-a))xX‘a  (x+Q). 

Thus  for  9 > 0 the  measure  <J>( 0j”6“Ydx)/^(0j  Q"Y)  converges 
( j to  a measure  whose  density  is  (l-a)x~a.  Since 


1 


38. 
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